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SHARPENING A DIGITAL IMAGE IN 



ACCORDANCE WITH MAGNIFICATION VALUES 
FIELD OF INVENTION 

The present invention relates to an improved method of sharpening 
5 a digital image for printing. 

BACKGROUND OF THE INVENTION 
In processing a digital image, it is common to sharpen the image to 
enhance fine detail with sharpening algorithms. Typically, sharpening is 
performed by a convolution process (for example, see A. K. Jain, Fundamentals of 
10 Digital Image Processing, Prentice-Hall: 1989, pp. 249 - 251). The process of 
unsharp masking is an example of a convolution-based sharpening process. For 
example, sharpening an image with unsharp masking can be described by the 
equation: 

s(x,y) = i(x,y)**b(x,y) + pf( i(x,y) - i(x,y)**b(x,y) ) (0) 

15 where: 

s(x,y) = output image with enhanced sharpness 

i(x,y) = original input image 

b(x,y) = lowpass filter 

p = unsharp mask gain factor 
20 f() = fringe function 

** denotes two dimensional convolution 

(x,y) denotes the x* row and the y* column of an image 

Typically, an unsharp image is generated by convolution of the 
image i(x,y) with a lowpass filter b(x,y) (i.e., the unsharp image is given by 
25 i(x,y)**b(x,y)). Next, a highpass, or fringe image is generated by subtracting the 
unsharp image fi-om the original image (i.e., the highpass data is found with i(x,y) 
- i(x,y)**b(x,y)). This highpass data is then modified by either a gain factor p or a 
fiinge function fQ or both. Finally, the modified highpass data is summed with 
either the original image or the unsharp image to produce a sharpened image. 

30 
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A similar sharpening effect can be achieved by modification of the 
image in a frequency domain (e.g., a Foiirier domain) as is well known in the art 
of digital signal processing. 

Digital images come in a variety of sizes (the number of rows and 
5 columns of pixels in an image describes the size of the image; also commonly 
referred to as resolution.) The size of digital image depends on many factors, 
including the inherent resolution of the image source (e.g. digital camera image 
sensor), digital camera settings, and whether and to what extent cropping or 
interpolation has been applied to the digital image. 

1 0 When prints are generated from a digital image, generally the size 

of the print is specified. Conmion photographic print sizes are 4x6 inches, 8x10 
inches, and 5x7 inches. Therefore, the magnification of the pixels of the digital 
image is dependent on the desired print size. The spatial area covered on the print 
by each pixel of the digital image is dependent on the print size. 

15 If a digital sharpening process is applied without knowing the 

magnification required to generate a print, there is no way of knowing which 
spatial frequencies of the print will be affected. Therefore, sharpening the digital 
image without knowing the size of the desired print results in sub-optimal quality. 

One solution to this problem is to resize the digital image using 

20 interpolation to a normalized size, such that spatial area covered on the print by 
each pixel of the resized digital image is standard. Then a standard sharpening is 
applied to resized digital image in preparation for printing. Generally, this process 
results in increasing the resolution of most digital images through interpolation. 
This in tum requires that more pixels be sharpened, which is inefficient. 

25 Another problem associated with sharpening digital images is that 

sharpening amplifies noise and other artifacts -e.g. the artifacts associated with 
JPEG compression, which is commonly used to reduce the file size of an image. 

It is occasionally desirable to sharpen different regions or pixels of 
the image by different amounts. For example, is it has been suggested that it is 

30 desirable to sharpen the pixels representing human faces to a lesser degree than 
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pixels representing a building. For example, in U.S. Patent No. 5,682,443 Gouch 
et al. describe the modification of the gain of the unsharp mask based on the color 
of a pixel (and the color of the surrounding neighborhood). Gouch did not 
describe sharpening of an image taking into account the magnification. In 
5 addition, Gouch *s sharpening method is not designed to minimize the 
amplification of compression artifacts. 

Alternatively, in U.S. Patent No. 4,571,635, Mahmoodi and Nelson 
teach a method of deriving a gain factor p that is used to scale the high fi-equency 
information of the digital image depending on the standard deviation of the image 

10 pixels within a neighborhood, hi addition, in U.S. Patent No. 5,081,692, Kwon 
and Liange teach that a gain factor p is based on a center weighted variance 
calculation, hi U.S. Patent No. 4,761,819, Denison describes a method where the 
gain factor of an unsharp mask is dependent on both a local variance calculation 
and a noise statistic. While these methods do indeed sharpen the image while 

1 5 attempting to minimize noise amplification, they are computationally complex. In 
addition, neither describes sharpening an image taking into account the 
magnification, or sharpening while minimizing the amplification of compression 
artifacts. 

Shimazaki in U.S. Patent No. 5,051,842 describes an apparatus 
20 which generates unsharp signals fi*om images, derives two parameters based on 
either the image signal level or the unsharp signal level firom a pre-determined 
lookup table, multiplies one parameter with the image signal, multiplies the other 
parameter with the unsharp signal, and adds the two resulting signals to obtain the 
final image signal. One embodiment requires that the siun of the two parameters 
25 equal one for all image signal levels. In this case, the method is mathematically 
equivalent to the unsharp mask equation. Shimazaki teaches that the two 
parameters are signal dependent with the signals representing image highlights 
resulting in the highest degree of sharpening. The two parameters are chosen such 
that the sharpening decreases as either the image signal or the unsharp signal 
30 decreases until the sharpening level is zero. At that point, the sharpening converts 
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to blurring as the image signal or unsharp signal continue to decrease into the 
shadow region of the density range. Shimazaki did not describe sharpening of an 
image taking into account the magnification. In addition, Shimazaki's sharpening 
method is not designed to minimize the amplification of compression artifacts. 
5 Gallagher and Gindele, in U. S . Patent No. 6, 1 67, 1 65 describe a 

method of selecting a gain for an xmsharp mask based on a local intensity level. 
Gallagher does not describe sharpening of an image taking into account the 
magnification. In addition, Gallagher's sharpening method is not designed to 
minimize the amplification of compression artifacts. 

10 Keyes and HofF, in U.S. Patent No. 6,091,861 describe a method of 

selecting a constant, position independent gain factor based on the exposure of the 
image. Lower gain factors will be selected for images that are underexposed, 
thereby providing less gain for that image than for a normally exposed image. 
Keyes describes sharpening of an image by setting a sharpening amount based in 

1 5 part on the image magnification. However, the Keyes method only varies the gain 
of a fixed filter. Unfortunately, this method produces sub-optimal effects for 
different spatial frequencies because the fi-equency response of the lowpass filter is 
constant. Prints of equal size made fi*om digital images having different numbers 
of rows and columns of pixels would have an inconsistent look. This results fi*om 

20 the frequency response of the blurring filter being fixed with respect to cycles per 
pixel, rather than being fixed with respect to a physical property of the print itself 
(e.g cycles per mm on the print, or cycles per degree.) In addition, the Keyes 
sharpening method is not designed to minimize the amplification of compression 
artifacts. 

25 Inoue and Tajima describe an adaptive method of determining a 

gain factor by analyzing the image and searching for edges in the article "Adaptive 
Image Sharpening Method Using Edge Sharpness," lEICE Transactions on 
Information and Systems, vol. E76-D, no. 10, p. 1 174-80, Oct. 1993. The authors 
describe a sharpening where the spatial firequency characteristics of a filter are 

30 properly described in terms of spatial firequencies (cycles/degree) (see Fig. 4 and 
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Equation 6 of the article). However, the authors do not describe an efficient 
method for generating the filter for images having various numbers of rows and 
column of pixels. In addition, the method is not designed to minimize the 
amplification of compression artifacts. 
5 In U.S. Patent No. 6,222,173, Meeussen describes a method of 

sharpening and resizing images to prevent the occurrence of images that are not 
crispy. The method involves combining a sharpening filter with the interpolation 
filter before application to the image. The method does not ensure that the image 
sharpening properly enhances the desired spatial frequencies of an output print. In 
10 addition, the method does not prevent the amplification of compression artifacts. 

SUMMARY OF THE INVENTION 
It is an object of the present invention to make use of the required 
magnification of the digital image to produce a sharpened digital image for 
printing. 

1 5 This object is achieved by a method of processing a digital image 

having pixels to improve the sharpness of a print generated from the digital image 
comprising: 

a) determining a magnification value representing the 
magnification of a pixel of the digital image on the print based on the number of 

20 input digital image pixels and the output number of digital image pixels; 

b) producing a filter in response to the magnification value; 

c) using the filter to operate on the digital image to adjust the 
sharpness of the digiteil image to produce a sharpened digital image; 

d) resizing according to the magnification value the sharpened 
25 digital image to produce a resized sharpened digital image which includes the 

output number of digital image pixels; and 

e) producing the print based on the resized sharpened digital 

image. 

An advantage of the present invention is that the magnification 
30 value is used in producing a filter to sharpen a digital image, thereafter the 



-6- 

sharpened digital image is resized in accordance with the magnification value to 
provide a high quality output print. The present invention can make use of 
metadata in addition to the magnification value to further improve the quality of 
the output print. 

5 An advantage of the present invention is that the digital image is 

sharpened prior to resizing the digital image thereby reducing the computational 
complexities. 

BRIEF DESCMPTION OF THE DRAWINGS 

FIG. 1 is a block diagram of a computer system suitable for 
1 0 practicing the present invention; 

FIG. 2 is a block diagram of the digital image processor of FIG. 1 
according to the present invention; and 

FIG. 3. is a graph of magnitude versus frequency illustrating the 
effects of kemel resampling. 
1 5 DETAILED DESCRIPTION OF THE INVENTION 

In the following description, a preferred embodiment of the present 
invention will be described as a software program. Those skilled in the art will 
readily recognize that the equivalent of such software may also be constructed in 
hardware. Because image manipulation algorithms and systems are well known, 
20 the present description will be directed in particular to algorithms and systems 

forming part of, or cooperating more directly with, the method in accordance with 
the present invention. Other aspects of such algorithms and S3^tems, and 
hardware and/or software for producing and otherwise processing the image 
signals involved therewith, not specifically shown or described herein may be 
25 selected from such systems, algorithms, components, and elements known in the 
art. Given the description as set forth in the following specification, all software 
implementation thereof is conventional and within the ordinary skill in such arts. 

The present invention may be implemented in computer hardware. 
Referring to FIG. 1 , the following description relates to a digital imaging system 
30 which includes an image capture device 10, a digital image processor 20, an image 
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output device 30, and a general control computer 40. The system can include a 
display device 50 such as a computer console or paper printer. The system can 
also include an input control device 60 for an operator such as a keyboard and or 
mouse pointer. The present invention can be used on multiple image capture 
5 devices 10 that produce digital images. For example, FIG. 1 can represent a 

digital photofinishing system where the image capture device 10 is a conventional 
photographic film camera for capturing a scene on color negative or reversal film, 
and a film scanner device for scanning the developed image on the film and 
producing a digital image. Altematively, the image capture device 10 could be a 

1 0 digital camera. The digital image processor 20 provides the means for processing 
the digital images to produce pleasing looking images on the intended output 
device or media. The present invention can be used with a variety of image output 
devices 30 that can include, but are not limited to, a digital photographic printer, 
an inkjet printer, and a soft copy display. The digital image processor 20 can be 

1 5 used to process digital images to make adjustments for overall brightness, tone 
scale, image structure, etc. of digital images in a manner such that a pleasing 
looking image is produced by an image output device 30. Those skilled in the art 
will recognize that the present invention is not limited to just these mentioned 
image-processing functions. 

20 The general control computer 40 shown in FIG. 1 can store the 

present invention as a computer program stored in a computer program product, 
which may include, for example: magnetic storage media such as a magnetic disk 
(such as a floppy disk) or magnetic tape; optical storage media such as an optical 
disc, optical tape, or machine readable bar code; solid state electronic storage 

25 devices such as random access memory (RAM), or read only memory (ROM). 
The associated computer program implementation of the present invention may 
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also be stored on any other physical device or medium employed to store a 
computer program indicated by offline memory device 70. Before describing the 
present invention, it facilitates understanding to note that the present invention is 
preferably utilized on any well-known computer system, such as a personal 
5 computer. 

It should also be noted that the present invention can be 
implemented in a combination of software and/or hardware and is not limited to 
devices that are physically connected and/or located within the same physical 
location. One or more of the devices illustrated in FIG. 1 may be located remotely 

10 and may be connected via a wireless connection. 

A digital image is comprised of one or more digital image 
channels. Each digital image channel is comprised of a two-dimensional array of 
pixels. Each pixel value relates to the amount of light received by the imaging 
capture device corresponding to the physical region of pixel. For color imaging 

15 applications, a digital image will often consist of red, green, and blue digital image 
channels. Motion imaging applications can be thought of as a sequence of digital 
images. Those skilled in the art will recognize that the present invention can be 
applied to, but is not limited to, a digital image channel for any of the above- 
mentioned applications. Although a digital image channel is described as a two 

20 dimensional array of pixel values arranged by rows and columns, those skilled in 
the art will recognize that the present invention can be applied to non rectilinear 
arrays with equal effect. Those skilled in the art will also recognize that for digital 
image processing steps described hereinbelow as replacing original pixel values 
with processed pixel values is functionally equivalent to describing the same 

25 processing steps as generating a new digital image with the processed pixel values 
while retaining the original pixel values. 

The digital image processor 20 shown in FIG, 1 is programmed to 
perform the method of the present invention is illustrated in more detail in FIG. 2. 
An original digital image 102 can be received from the image capture device 

30 (shown in FIG. 1) in a variety of different color representations. However, the 
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most typical implementation of the present invention receives the original digital 
image as a color digital image with red, green, and blue digital image channels. 
Preferably, the pixel values of the original digital image are in the sRGB color 
space. The present invention can operate successfully with other encodings, 
5 although modification to equation constants and shapes of functions may be 
required. 

The digital image 102 is input to a magnification determiner 106. 
A print request 104 is also input to the magnification determiner 106. The 
purpose of the magnification determiner 106 is to calculate the size on the print of 

10 each pixel of the digital image 102. The print request 104 contains a specified 
desired size for the output print. Preferably, the print request 104 contains the 
desired print size P for the shorter dimension of the image. Then the 
magnification value (M) is foxmd by the magnification determiner 106 by dividing 
the number of pixels along one dimension of the new digital image by the 

1 5 corresponding dimension of the print: 
M = X/P(1) 

Where: 

X is the number of pixels along the shorter dimension of the digital image 

102. 

20 In essence, the magnification value is found by considering the 

relationship between the size (in pixels) of the digital image and the size (in linear 
distance or in pixels) of the output print. For example, if the digital image has 
1000x1500 pixels and the desired print size (short dimension) is 4 inches, then the 
magnification is M = 250 pixels per inch. 

25 Those skilled in the art will recognize that the magnification value 

can be computed in other ways that achieve the same goal. For example, the print 
request 104 may specify both dimensions (width and height) of the desired print 
size. If the aspect ratio (ratio of with to height) of the image in pixels is the same 
as the aspect ratio of the print, then M is found as described before. However, if 

30 the aspect ratios are different, then either the digital image must be cropped 
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(remove rows and /or columns of pixels) or padded (add rows and/or columns of 
pixels) to create a new digital image having the same aspect ratio as the print. In 
this case, M is again found by dividing the number of pixels along one dimension 
of the new digital image by the corresponding dimension of the print. 
5 The magnification value M is output from the magnification 

determiner 106 and input to a filter size determiner 108. The purpose of the filter 
size determiner 108 is to set a size parameter of the lowpass filter for use in an 
unsharp mask. The size parameter a can be determined from the magnification 
factor M with a look-up-table. Preferably, the size parameter a is found according 

10 to the equation: 

a = M/ D (2) 
where D is the resolution (in units of pixels per inch) of an output display device 
such as a computer display or a printer (e.g., 250 dpi). In the preferred 
embodiment, the size parameter a relates to the number of pixels per standard 

1 5 deviation in a Gaussian lowpass filter. 

A filter generator 112 inputs the size parameter a from the filter 
size determiner 108. The purpose of the filter generator 1 12 is to generate, in 
response to the magnification value, a lowpass filter for convolution. The 
Gaussian filter is a two-dimensional, circularly symmetric, low-pass filter whose 

20 filter coefficients may be derived by the following formula that is well known in 
the art: 



25 



b(i,j)= 
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av27c ^ la"^ 
where: 

b(i j)=the Gaussian filter coefficient at the (i, j)* pixel 

a=the standard deviation of the Gaussian filter 

7C=theconstant approximately 3.14159265 . , . 
The Gaussian filter is more efficiently implemented as a separable filter as is well 
known in the art of digital signal processing. The equation for the vertical 



separable Gaussian filter is: 
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where: 



5 



b(i J)=the Gaussian filter coefficient at the (i, j) pixel 



a=the standard deviation of the Gaussian filter 
7C=the constant approximately 3.14159265 . . . 

The filter generator 112 outputs the filter b(i j) to a sharpener 114. 
The filter generator 112 can alternatively generate the filter by having a pre-stored 
10 set of filters. Then the generated filter b(ij) is found by performing a look up 

operation, where the size parameter a is used as an index to select a specific filter 
from the pre-stored set of filters. 



by sampling any other continuous function (e.g., a standard lowpass filter) in 
15 accordance with the magnification value to produce coefficients of a new lowpass 
filter. In this case, an interpolation factor is determined; preferably the 
interpolation factor is l/o. Then, the lowpass filter is calculated by sampling the 
continuous function at sample locations having an interval (equal to the 
interpolation factor l/o) between sample locations. 
20 Altematively, the filter generator 112, can produce the lowpass 

filter used to sharpen the image using the unsharp-masking process can be 
acquired by providing a default discrete digital filter and adjusting the coefficients 
of the default filter in accordance with the magnification factor. This process is 
directly analogous to the previously mentioned process of sampling a continuous 
25 function in accordance with the interpolation factor. The default filter in sampled 
using a discrete sampling function at points (1/a) to produce a resampled filter. 
For example, if the standard lowpass filter is a 1x5 pixel filter (5 non-zero kernel 
values), and the interpolation factor is 0.5, then the filter generator 112 calculates 
an output filter having 9 non-zero values. Interpolation can be accomplished by 



As a further alternative, the filter generator 112 can create the filter 
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any of several means well known in the art such as linear interpolation. Special 
care needs to be used when generating said sampling function to ensure that the 
resampling process is performed within the support of the default filter. 

The effect of using the magnification value M to generate the filter 
5 (with the filter generator 112) used in the sharpening process, is that a constant 
spatial fi-equency boost is provided without regard to the size (in pixels) of the 
input image. In prior art methods, the input image is sharpened first and then 
resized to the resolution of the output writing device. The spatial fi-equency 
response of the sharpening kemel is scaled according to the interpolation factor 
10 used to convert the sharpened image to the resolution of the output printer. This 
prior art method resuhs in inferior print quality because the sharpening effect with 
respect to spatial fi-equency varies according to the digital image dimensions in 
pixels. 

Referring to FIG. 3, consider the sharpening process that results in 

15 a spatial frequency boost according to a solid curve 120. In this case, the image 
resolution matches the resolution of the output-writing device - as such, the 
interpolation factor and the magnification value M is one. This graph illustrates 
the magnitude versus frequency of the sharpening and resizing process. For cases 
where the interpolation factor is two, the spatial frequency response of the 

20 sharpening kemel follows a curve 122 denoted by the (o) symbol. This curve 
illustrates the spatial frequency effects of sharpening an image (with the same 
digital filter used to produce curve 120) followed by an interpolation by 2. It is 
clear that the spatial frequency effects are quite different. Images sharpened (with 
the default filter) and then interpolated to the printer resolution using the 2-times 

25 interpolation factor are more likely to contain image structure features (such as 
noise or blocking) that will now be more visible because of the extra low 
frequency boost resulting from interpolating the sharpened image. In order to 
keep the frequency response of the sharpening kemel constant across interpolation 
factors the aforementioned kemel resampling process is applied by the filter 

30 generator 1 12 to produce a digital filter b(ij). Still referring to FIG. 3, a resulting 
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frequency response of the kernel b(i j) followed by an resizing step (interpolation 
by 2) resampling process is shown by the curve 124 labeled with the (+) symbol. 
Note that the spatial frequency response of this kernel is more similar to that of the 
default (curve 120), Thus, noise amplification is suppressed in this case 
5 Referring again to FIG. 2, a gain determiner 110 inputs metadata 

100 (data related to the digital image 102, not including the values of the pixels 
themselves) and determines the gain P used to sharpen the image. Conceptually, 
the filter generator 112 determines the shape of the frequency response of the 
sharpening operation applied by the sharpener 114, while the gain determiner 110 
1 0 determines the gain p or magnitude of the sharpening operation applied by the 
sharpener 114. 

The gain determiner 110 determines the gain P by making a 
combination of the metadata values as expressed with the following formula: 
P= oco + aiMi +a2M2 + a3M3 + ... (XnM„ (5) 
1 5 Where: otk is the k* (for k = 0, 1 , . . . n) coefficient of the gain determiner and Mk is 
the k* metadata attribute for the input image i(x,y). In a preferred embodiment of 
the present invention the gain determiner, given in Equation 5, includes 
coefficients and metadata (i.e., factors) for: 

ai = a coefficient for a camera focal length used to capture an 
20 image=0.014. 

Ml = a focal length of the camera used to capture the image, 
a2 = a coefficient for a camera ISO used to capture an image = 
-0.0017, 

M2 ~ an ISO value for the camera used to capture an image, 
25 as = an image compression factor coefficient = 0,01 1 , 

M3 = an image compression factor calculated for an image, 
04 = an interpolation factor coefficient = -0.43, 
M4 = an interpolation factor calculated for an image, and 
0(0 = an offset coefficient = 1 .70. 
30 These parameters were obtained with psycho visual experiments. Observers 
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selected optimally shaipened prints out of a variety of choices. Regression 
analysis was then performed to determined which metadata items are most 
effective for determining the gain factor p. Often times these and other metadata 
items are stored in the digital file that contains digital image data. 

In a preferred embodiment of the present invention the default low- 
pass filter used in the sharpening process is a 1x5 element filter with the 
coefficients of [0.1004, 0.2396, 0.3200, 0.2396, 0.1004]. 

An example of an image compression factor is obtained for a JPEG 
image file by comparing the quantization table associated with the luminance 
channel of said JPEG compressed image to a reference quantization table. The 
degree of similarity between the aforementioned quantization tables can be used to 
form a compression factor. 

These metadata items are ones that are commonly associated with a 
digital image or ones that are calculated from characteristics of a given digital 
image 102. This formula and its coefficients are based on empirical data firom 
tests where subjects selected the preferred gain value for many different images 
having many different values of metadata items. Metadata can include but is not 
limited to the following: 

Time and Date of image capture 

Location of Image 

Number of people present in image 

Number of faces in image 

Amount /location of human flesh 

Aperture 

Focal length 

Shutter speed 

Lens MTF 

Flash fire information 
Camera manufacturer 
Brightness value 



-15- 

Subject to camera distance 

Image soiirce (e.g digital camera vs. film scan ) 

Image sensor speed (e.g. ISO rating) 

Other metadata items that can be used to calculate the gain value p 
5 include parameter settings for image processing algorithms that have been or will 
be applied to the digital image. For example, in the case where a scene dependent 
tone scale function or a balance value is applied to the digital image, the tone scale 
function or parameters derived from the tone scale function can be used to 
determine the gain value p. Generation and application of scene dependent tone 

10 scale functions is described in U.S. Patent No. 6,285,798, U.S. Patent Application 
Publication No. 20030039401 Al describes a method of using the tone scale 
function and noise information (both metadata items) to produce a noise estimate 
for the image. The noise estimate is a metadata item that can be used to determine 
the gain value. As an additional example, when a noise reduction process (e.g. J.- 

15 S. Lee, "Digital Image Smoothing and the Sigma Filter", Computer Vision, 

Graphics, and Image Processing, Vol. 24, pp. 255-269, 1983) is used, generally 
the value of P can be increased. Thus a noise value flag (a metadata item) 
indicating whether noise reduction is applied to the image is useful for 
determining the value of p. Therefore the gain value is calculated in response to a 

20 tone scale value (the tone scale function), a balance value, a noise value or 
combinations thereof. 

The sharpener 114 inputs both the gain value p and the filter b(i j) 
and the digital image 102, and adjusts the sharpness of the digital image, 
producing a sharpened digital image. The sharpener 114 sharpens the digital 

25 image 1 02 using the gain and filter as an unsharp mask, as is well known in the 
art. 

The operation of the sharpener 114 can be represented with the 
following equation: 

s(x,y)=R{x,y)**b{x,y) + P(x,y)f(R(x,y)-R(x,y)**b(x,y)) (6) 

30 where: 
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s{x,y) = output image with enhanced sharpness 

R(x,y) = digital image 

b(x,y) = lowpass filter (described above) 

|3(x,y) = unsharp mask gain factor for location (x,y). Preferably in 
5 the value p(x,y) is a constant. However, as an alternative, the gain value 

may vary with position (x,y) within the image. 

f{) = fringe function (preferably identity f(g) = g; ) 
R(x,y)**b(x,y) = lowpass image (also called unsharp image) 
R(x,y)-R(x,y)**b(x,y) = highpass image 
10 ** denotes two dimensional convolution 

(x,y) denotes the x^^ row and the y^^ column of an image 
The sharpener 114 can effectively be bypassed (made to have an 
identity effect) when either the gain p is 1.0 or the filter b(i J) is a delta function. 
When either of these conditions exist, it is most efficient that the sharpener 114 
1 5 does not explicitly evaluate Equation (6), but rather simply output the digital 
image, as the sharpening operation would not change it. 

Those skilled in the art will recognize that there are several 
methods by which unsharp masking (such as provided by Eq. (6)) can be applied 
to a color image having multiple channels. For example, the unsharp mask 
20 process can be applied to each channel of the color image. Preferably, the unsharp 
mask process is applied in the following manner, commonly known in the art: 

Assuming the input image is a color image consisting of red, green, 
and blue color channels, a matrix is first applied to the image in order to produce a 
luminance channel and two or more color difference channels. The luminance 
25 channel l(x,y) is created by linearly combining all the color channels of the image. 
For example: 

n=C-l 

l(x,y)= Ia„c„(x,y) (7) 
n=0 

where: 

C is the number of image channels. 
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Cn is the color channel of the image Hx,y) 
a„ is the coefficient weighing factor for the color channel. The 
sum of all the coefficient weighting factors is preferably 1 .0. 

In the case of an image iix,y) having red, green, and blue channels, 
5 the preferred values for the red, green, and blue coefficient weighting factors are 
all equally 1/3. Next the unsharp mask process is applied by the sharpener 1 14 to 
the luminance channel. Finally, an inverse matrix is applied to the luminance and 
color difiTerence channels to generate an enhanced color image having red green 
and blue channels. 

10 Alternatively, the unsharp mask process may be applied to only a 

single image channel (e.g. the green channel), and the modified highpass data may 
be summed with each color channel in order to generate an enhanced color image. 
These and other similar modifications and enhancements to the unsharp mask 
process would be well understood by those of skill in this art. Since the 
1 5 particularities of their usage are not fimdamentally related to the method of 

selecting sharpening parameters for the variable gain sharpening, their particular 
application does not act to in any way limit the scope of the invention. 

Those skilled in the art will also recognize that although Eq. (2) 
and the present invention generally describe the sharpening applied to the image as 
20 being performed by an unsharp mask, that is not necessarily the case. Assuming 
the fiinge fimction fO of Eq. (4) is identity, the unsharp mask process can be 
reconfigured as a single filter than can be applied with convolution to the image 
and produce results identical to the unsharp mask. For example, suppose the filter 
coefficients of b(x,y) are given as: 

"1 2 1" 



25 b(x,y)=^ 



2 4 2 
1 2 1 



(8) 
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Application of a filter c(x,y) with a convolution having coefficients 

given as: 



c(x,y) = -!- 
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' 1-p 2(1-P) 1-p ' 

2(1 -p) 4(1 + 3P) 2(1 -p) 

1-p 2(1-P) 1-p _ 



(9) 
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will produce identical results compared with using filter b(x,y) in the 
unsharp mask of Equation (4). Such modifications to the preferred embodiment 
by the grouping of operations in the image sharpener 114 such as can be 
5 determined by methods well known in algebra and digital signal processing will be 
evident to those of skill in this art and are within the scope of the present 
invention. 

Each channel of the digital image may be operated upon by the 
sharpener 114. Preferably, each color channel is treated in an independent 

10 manner. Alternatively, it may sometimes be desirable for the gain factor p to be 
fixed across color channels at each pixel location (x,y) throughout the image. 

The sharpener 114 outputs a sharpened image that is input to an 
interpolator 116. The interpolator 116 resizes the sharpened image to have the 
proper resolution for the image output device 30 of FIG. 1 . For example, if the 

1 5 print request 1 04 specifies that a 4x6 print is desired, and the image output device 
30 operates at 300 pixels per inch, then the interpolator 116 resizes the sharpened 
image to have 1200 by 1800 pixels. Alternatively, the image could be re-sized to 
have slightly more rows and columns of pixels (e.g. 1260 by 1890 pixels) to 
account for overprinting to ensure that the image extends beyond the photographic 

20 print edges to avoid the creation of a print with (unintended) white image borders. 
Interpolation of a image is well known in the art and can be accomplished by 
using a filtering and a sub-sampling step. Preferably, either bilinear or bicubic 
interpolation are performed by the interpolator 116. The interpolator 116 can 
increase the number of pixels in the image, decrease the number of pixels in the 

25 image, or leave the image unchanged, as appropriate such that the resized 
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sharpened digital image includes the necessary output number of digital image 
pixels to generate the print. An enhanced digital image 1 18 is a resized sharpened 
digital image and is sent to the image output device of FIG. 1 for producing a 
print. 

5 The method of the present invention can be performed in a digital 

camera, a digital printer, or on a personal computer. 

The method of the present invention can be used in a system 
designed to print digital images. In this case the present invention will improve 
the sharpness of a print generated from that system. Those skilled in the art will 
10 recognize that a similar system will successfully prepare the sharpness of an image 
for viewing on a display such as a CRT monitor, an LCD screen or even by 
overhead projection onto a projection screen. 

The invention has been described in detail with particular reference 
to certain preferred embodiments thereof, but it will be understood that variations 
1 5 and modifications can be effected within the spirit and scope of the invention. 
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image capture device 


20 


digital image processor 


30 


image output device 


40 


general control computer 


50 


display device 


60 


input control device 


70 


offline memory device 


100 


metadata 


102 


digital image 


104 


print request 


106 


magnification determiner 


108 


filter size determiner 


110 


gain determiner 


112 


filter generator 


114 


sharpener 


116 


interpolator 


118 


enhanced digital image 


120 


curve 


122 


curve 
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curve 



